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Abstract. Lin and Chang gave a generating function of convex polyominoes with an to + 1 by n + 1 
minimal bounding rectangle. Gessel showed that their result implies that the number of such polyominoes 
is 

m + n + mn I 2to + 2n\ 2mn Im ^ 



m + n \ 2m J to + n \ m 
We show that this result can be derived from some binomial coefficients identities related to the generating 
function of Jacobi polynomials. 

Some (binomial coefficients) identities arise from alternative solutions of combinato- 
rial problems and incidentally give added significance to doing problems the "hard" 
way. 
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1 Introduction 

A polyomino is a connected union of squares in the plane whose vertices are lattice points. A 
polyomino is called convex if its intersection with any horizontal or vertical line is either empty 
or a line segment. Any convex polyomino has a minimal bounding rectangle whose perimeter 
is the same as that of the polyomino. Delest and Viennot [4] found a generating function for 
counting convex polyominoes by perimeter and showed that the number of convex polyominoes 
with perimeter 2n -|- 8, for n > 0, is 

(2n+ll)4"-4(2n + l)f^"y (1) 
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Later, Lin and Chang [9] gave a generating function for the number of convex polyominoes with 
an (m + 1) x (n + 1) minimal bounding rectangle, and Gessel [6] showed that their result implies 
that the number of such polyominoes is 

m + n + mn / 2m + 2n\ 2mn / m + n 
m + n \ 2m J m + n\ m 

which is easily seen to give a refinement of Delest and Viennot's formula. 

Since Gessel [6] (see also Bousquet-Melou [2]) derived (j2| from the generating function of 
Lin and Chang [9] (see also Bousquet-Melou and Guttman [3]), it would be interesting to find 
an independent proof of ((2). For Delest and Viennot's formula such a proof was already 
given by Kim [8]. The aim of this paper is to provide such a proof for ^ by generalizing Kim's 
elementary approach. It turns out that the resulting binomial coefficients identities are related 
to the generating function of Jacobi polynomials. 

In the next section, we translate the enumeration of convex polyominoes with fixed minimal 
bounding rectangle as that of two pairs of non intersecting lattice paths, which results to evaluate 
a quadruple sum of binomial coefficients. In Section 3, we establish some binomial coefficients 
identities which lead to the evaluation of the desired sums. 




2 Non intersecting lattice paths and determinant formula 

A lattice path is a sequence of points {sq, si, . . . , Sn) in the plan I? such that either Si — = 
(1, 0), (0, 1) for alH = 1, . . . , n or si — Sj_i = (1, 0), (0, —1) for alH = 1, . . . , n. Let 'Pm,n be the 
set of convex polyominoes with an m + 1 by n + 1 minimal bounding rectangle. As illustrated 
in Figure n any polyomino in Vm,ri can be characterized by 4 lattice paths Li, L2, L3 and L4 
which are given by 

Li: (0,61) (ai,0), 

L2: (m+l-a2,n + l) — > (m + 1, n + 1 - 62), 
L3: (ai + 1,0) — >(m + 1,71-62), 
L4: (0,61 + 1) — >(m-a2,n + l). 

Note that a polyomino in 'Pm,n is convex if and only if the two lattice paths Li,L2 (resp. 
-L3, L4) don't intersect. The following lemma can be readily proved by switching the tails of two 
lattice paths, which is also a special case of a more general result [7]. 

Lemma 1 Let a, 6, c and d he non negative integers such that a' > a, b > b' , c > a, d > b, 
c' > a' and d' > b' . Then the number of pairs of non intersecting lattice paths {Vi,V2) such that 
Vi : (a, 6) — > (c, d) and V2 '■ (a', 6') — > (c', d') is given by 

fc-a + d-b\fc' -a' + d' -b'\ fc-a' + d- b'\ fc' -a + d' - b\ 
V c-a )\ d -a' )~\ c-a' )\ d -a J' 
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n + 1 



m + 1 — 02 



bi 



La 



n + 1 - 62 



m + 1 



ai 



Figure 1: A convex polyomino with an m + 1 by n + 1 minimal bounding rectangle. 



It follows that the cardinality of Vm,n is given by 

ai + a2 + n — m — 2\ fhi + 1)2 + m — n — 2 
n — 1 / \ m — 1 



E 



E 

01,02=0 bi,b2=0 



ai + bi- 2\ fa2 + 62-2 
ai - 1 A 02-1 



m + n — a2 — bi \ fm + n — ai — b2\ fm + n — ai — a2\ fra + n — bi —1)2 
m — a2 J \ m — ai J \ n + 1 J \ m+1 
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(3) 



Note that in Q we have adopted the convention that (_-^) = 1, which corresponds to ai = 61 = 
or 02 = 62 = 0. In this case the path Li or L2 is a point. 

We next split the sum in © into three terms: the ai = 02 = 61 = 62 = term, 

/m + n\^ fm + n\ (m + n\ 
\ m J \m — 1 J \ n — 1 J 

the oi = 61 = or a2 = 62 = terms, 

'a + 6 - 2 
a- 1 



Si 



m n 

2EE 

a=l 6=1 



m + n — a\ fm + n — b 
m — a 1 \ m 



m + n — a\ f m + n — b 
n+1 /\ m+1 



and the sum in ^ for aj and bi > 1. This third term can be split into four more terms obtained 
from the product: (011022 — ai2a2i)(ftii^22 — ^12^21) = S2 — S3 — + S^. The last sum S5 is 
because the sum of the numerator parameters of binomials coefficients are less than that of the 
denominator parameters. 



We now proceed to evaluate or simplify Si, S2, S3 and S4 using the Chu-Vandermonde 
formula: 

-n, a ^^^^ (-n)k{a)k (c-a) 



2F1 



k>0 



{C)r 



where {x)n = x{x + 1) . . . (x + n — 1) for n > 1 and (x)o = 1. 



• Applying the Chu-Vandermonde formula to the 6-sums for Si yields 

+ n — o\/m + n + o — 1 
n I \ n — 1 



Si = 2^ 



a=l 



m + n — a\ /m + n + a— 1^ 
n+1 )\ n-2 



3 



As 



m + n ~ a\ /m + n + a — l\ /m + n — a\ /^m + n + a — 1 
n )\ n-1 )\ n+1 )\ n-2 

m + n — a+l\/m, + n + a — V\ /m + n — a\/m + n + a 
n+1 )\ n-1 ) V ri + l )\ n-1 



by telescoping it follows that 

^-<::r)(::r)- 

• Consider now the second sum 5*2: 

^ _ / ai + bi - 2\ / a2 + b2 - 2\ /m + n - a2 - &i\ /m + n - ai - 62 

^ ,,T^,\ai-lJ\a2-lJ\ m-02 J\ m-ai 

01,02=161,62=1 

By the Chu-Vandermonde formula we have 



E 

61=1 

n 

E 

62=1 



ai + hi ~ 2\ fm + n — a2 — hi\ /m + n + oi — 02 — 1 

ai — 1 ) \ m — 02 / \ n — 1 

a2 + h2 — 2\ fm + n — a\ — h2\ /m + ra — 01+02 — 1 

02 — ly\ m — oi y V n — 1 



Hence 



52= 

01,02=1 

Setting a = Oi — 02 we can rewrite the above sum as 



m + n + oi — 02 — 1\ /m + n — 01 + 02 — 1 
n — 1 J \ n — 1 



„ \ - ,,r, , r, i2i ^fm + n + a-l\fm + n-a-l\ 

S2= #{(01,02) e [l,m]^ I 01 -02 = o}( j( 1 

o=l— m ^ ' ^ ' 

E*" / I |s/?Ti + ra + o — l\/m + n — o- 1\ 
("^-I'^l^ n-1 n-1 J 



™ + n + o — l\/m + n — o- 1 



m 

o=— m 



E 

i=— r 

m 

2^0 



n — 1 / \ n — 1 



+ n + a — 1\ f m + n — a — 1 



n — 1 J \ n — 1 



0=1 

By the Chu-Vandermonde formula we have 



m 



E/m + n + o — l\/?n + n — o - 1\ / 2m + 2n — 1 
I _ II . I = m 



o=— m 



n — 1 7V n — 1 7 V 2n — 1 
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Since 

2a 



m + n + a — l\fm + n — a — 1 
n — 1 J \ n — 1 



+ n + a — l\/m + n — a\ /m + n + a\ /^m + n — a — 1 
n J \ n J V n J \ n 



telescoping yields 



m + n + a — l\/'m + n — a — l\ / m + n\ / m + n — 1 



a=l 

Hence 
• Look at the term S?,: 



n — I J \ n — 1 J \ n J \ n 



2 

mn i2m + 2n\ mn (m + n^ 



^2 = -^ ' -— — ' . (6) 
m + n\ 2m J m + n\ m 



3- 

m n 



E E 

ai,a2=l 61,62=1 



ai + a2 + n — m — 2\^bi + b2 + n — m — 2 
n — 1 ) \ m — 1 



m + n — a2 — b{\ /m + n — ai — 62 
m — a2 J \ m — ai 



Summing the a2-sum and 62-sum by the Chu-Vandermonde formula yields 



E 

02=1 

n 

E 

62=1 



^2n + ai — 61 — 1 
n — 1 J \ m — a2 J \ ai — 1 



m + n 


-02-^1 


m 


- 02 


m + n 


- ai - 62 


m 


- ai 



2m — ai + 61 — 1 
m — 1 J \ m — a^ J \ 61 — 1 



Hence, replacing ai and 61 by a and b respectively we get 

f — CL + b — 1\ f2n + a — h — l 



a=l 6=1 

m n 

EE 



6-1 J \ a-1 
m + n + a — b — l\fm + n — a + b— 1 



m+a—1 J\ n+b—1 



a=i 6=1 

by the substitutions a <— m — a + 1 and 6 <— n — 6 + 1. 
• Finally we have 



m. n 



E E 

ai,a2=l 61,62=1 



oi + 61 - 2\ /a2 + 62 - 2\ /m + n - ai - a2\ /m + n — 61 - 62 
ai-lyV 02-1/1 '^ + 1 /V + 1 
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Summing the ai-sum and 62-sum by the Chu-Vandermonde formula yields 

^ai + bi — 2\ /m + n — ai — a2\ /m + n — 02 + ^1 — 1 
ai-1 )[ n+1 yl n + 61 + l 



ai=l 
n 



02 + 62 - 2\ /m + n - 61 - 62\ _ fm + n + a2-hi-l 
02-1 yV m + 1 J \ m + a2 + l 



E 

62=1 

Substituting 02 and 61 by a and 6 we obtain 

m—2 n—2 



s—^ sr-^ I m + n + a — h — V\ Im + n — a + h — 1 
^~^f-fV m + a + l )\ n + b+l 

a=l b=l 

for the summand is zero if a = m — 1, m or 6 = n — 1, n. 
We shall evaluate 5*3 and 5*4 in the next section. 

3 Jacobi polynomials and evaluation of 6*3 and ^4 

Set 

A := ^/l-2x-2y- 2xy + + y^. 
The following identity is equivalent to the generating function of Jacobi polynomials: 

- ^m + n + a\(m + n + p\^ 

^^0^ m J\ n J A(l + y + A)°(l + x-y + A)/^' 

The reader is referred to [1, p. 298] and [10, p. 271] for two classical analytical proofs and to [5] 
for a combinatorial proof. 

Applying the operator x-^ + y-^ + 2 to the a = /? = 1 case of © yields: 

Em + n/m + n-l\/'m + n-l\j^^_xy 
2 I m )\ n ^ ~ A3' 



Theorem 2 We have 

mn m + n 



2(m + n)\ m 

Proof. Consider the generating function of S4: 

N -^-J^ /m + n - a + b - 1\ /m + n + a - b - l\ ^ „ 

F{.,y):=Y.Y.Y.[ )[ n-b 

m,n=0 a=l b=l ^ ^ ^ ^ 

n h \^ \^ fm + n - a + b - 1\ /m + n + a - b - 1\ 

= EE-VEE( )[ n-b r y 

a=l 6=1 m=a n=b ^ ^ ^ ' 



(9) 



E°° ah V"^ /m + n + 26 — l\/m + n+2a — 1\ 

a,b=l m,n=0 ^ ^ ^ ' 
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Applying ^ to the inner double sum yields 

^^^^ A(l-x + 2/ + A)2''-i(l + x-y + A)2«-i A^' 

The theorem follows then from (jHJ. 

Theorem 3 There holds 

^ + n\'^ ^ /m + n\ + ri\ ^ mn /m + n\^ /2m + 2n^, ^^^^ 

\ m J \m — 1 J \n — 1 J 2(m + n) \ m J \ 2n 

Proof. Consider the generating function of S4: 

00 m—2 n— 2 



m,n=0 a=l 6=1 ^ 



m + n — a + b— l\jm + n + a — b— 1 
m — a — 2 I \ n — b — 2 



EE E E ( ^_«_2 j( n-b-2 1^ ^ 

a=l 6=1 m=a+2 ra=6+2 ^ ^ ^ 



^ ^a+2y6+2 ^ |'m + n + 26 + 3\ /m + n + 2a + 3 j^^^„ 



a, 6=1 m,n=0 

Applying ((71) to the inner double sum yields 



°° 02a+26+6 
r<(^ „,^ ^ a+2 6+2 f 

^{■^,y) Z^-^ y A(l -x + y + A)2f'+3(l + x-2/ + A)2«+3 



a,6=l 



A3(l-x-y + A)4" 

Set 



oo ^ , 1 



X y 



, ... , 1 — X — y 

m.,n=0 ^ ^ ^ 



By bisecting twice, we get the terms of even powers of x and y in f{x,y): 



m,n=0 

i.e., 



'2m + 2n^ _ 1 - x - y 



2m A2 



E 

r?i,n=0 

Now, the a = (3 = and a = /? = 2 cases of (jT)) read: 

^m + n\ „ 1 



E 



m,?i=0 

oo 



I X y 
ml A 



E 

m,n=l 



. X y 

m — lj\n — lj A(l — X — y + A)2 
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As 

IGx^y'^ 1 4xy xy 1 — x — y 

A3(l-x-y + A)4 " A ^ A(l-x-y + A)2 + A3 A2 ' 

extracting the coefficients of x™'y"' in the above equation completes the proof. I 

Summarizing, formula @ follows then from © and H10|l . 
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